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Abstract. 

We consider the inverse problem of determining the permeabihty from the pressure in a Darcy 
model of flow in a porous medium. Mathematically the problem is to find the diffusion coefficient 
for a linear uniformly elliptic partial differential equation in divergence form, in a bounded domain 
in dimension d < 3, from measurements of the solution in the interior. 

We adopt a Bayesian approach to the problem. We place a prior random field measure on 
the log permeability, specified through the Karhunen-Loeve expansion of its draws. We consider 
Gaussian measures constructed this way, and study the regularity of functions drawn from them. 
We also study the Lipschitz properties of the observation operator mapping the log permeability to 
the observations. Combining these regularity and continuity estimates, we show that the posterior 
measure is well-defined on a suitable Banach space. Furthermore the posterior measure is shown to 
be Lipschitz with respect to the data in the Hellinger metric, giving rise to a form of well-posedness 
of the inverse problem. Determining the posterior measure, given the data, solves the problem of 
uncertainty quantification for this inverse problem. 

In practice the posterior measure must be approximated in a finite dimensional space. We 
quantify the errors incurred by employing a truncated Karhunen-Loeve expansion to represent this 
meausure. In particular we study weak convergence of a general class of locally Lipschitz functions 
of the log permeability, and apply this general theory to estimate errors in the posterior mean of 
the pressure and the pressure covariance, under refinement of the finite dimensional Karhunen-Loeve 
truncation. 

1. Introduction. There is a growing interest in uncertainty quantification for 
differential equations in which the input data is uncertain. In the context of elhptic 
partial differential equations much of this work has concentrated on the problem of 
groundwater flow in which uncertainty enters the diffusion coefficient in a divergence 
form elliptic partial differential equation. Here there has been substantial work in 
the numerical analysis community devoted to quantifying the error in the solution 
of the problem in the case where the diffusion coefficient is a random field speci- 
fied through a Karhunen-Loeve or polynomial chaos expansion which is truncated 
mmiZllllIllIHlIinilllllllllllST]. However in practice the unknown diffusion 
coefficient is often conditioned by observational data, leading to an inverse problem 
[20] . This gives rise to a far more complicated measure on the diffusion coefficient. 
The purpose of this paper is to study this inverse problem and, in particular, the effect 
of approximating the underlying probability measure via a finite, but large, set of real 
valued random variables. Much of the existing numerical analysis concerning ground- 
water flow with random permeability requires uniform upper and lower bounds over 
the probability space, and hence excludes the log normal permeability distributions 
widely used in applications. An exception is the recent paper [6] in which the log 
normal case is studied. For the inverse problem we study here we also use log normal 
priors which are attractive from an inverse modeling perspective precisley because no 
prior bounds on the permeability may be known. A key tool when working with log 
normal distributions, and hence Gaussian measures, is the Fernique theorem which 
faciltates functional integration of a wide class of functions, including the exponential 
of quadratics, against Gaussian measures [llj . The paper [6] exemplifies the key role 
of the Fernique theorem and it will also be used extensively in our developments of 
the inverse problem. 
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We consider the elliptic equation 



-V-(e"Vp)-/ + V-g, xeD, 

p = (j), xedD, ^ ' 

with D an open, bounded and connected subset of R'', d < 3, p, u, f and cj) scalar 
functions and g a vector function on D. Given any u G L°°{D) we define \{u) and 
A(m) by 

\{u) = ess inf e"'^''\ A(u) = ess sup e"'^^^ 

Where it causes no confusion we will simply write A or A. Equation (|l.ip arises as 
a model for flow in a porous medium with p the pressure (or the head) and e" the 
permeability (or the transmissivity); the velocity v is given by the formula v oc — e"Vp. 

Consider making noisy observations of a set of linear functionals Ij of the pressure 
field p, so that Ij : p y-^ lj{p) £ We write the observations as 

yi^ljip)+Vj, J = 1,---,K. (1.2) 

We assume, for simplicity, that 77 = is a mean zero Gaussian observational 

noise with covariance T. In this paper we consider to be cither: 

a) pointwise evaluation of p at a point Xj G D (assuming enough regularity for 
/, g and (j> so that this makes sense almost everywhere in D); or 

b) Ij : H^{D) ^> M, a functional on H^{D) (again assuming enough regularity 
for /, g and 4> so that p e H^{D)). 

Our objective is to determine u from y = {yj}f^i G K^. We adopt a probabilistic 
approach which we now outline. In the sequel we derive conditions under which we 
may view lj{p) as a function of u. Then, concatenating the data, we have 

y = Q{u) +77, 

with 

g{u) = {h{p),--- M{p)T- (1.3) 

Here the observation operator Q maps X into where X is a Banach space which 
we specify below in various scenarios and is determined by the forward model. From 
the properties of rj we see that the likelihood of the data y given u is 



^{y I u) cxexp(-i|r-^(y-e(ti)) 



where | • | is the standard Euclidean norm. Let P(m) denote a prior distribution on 
the function u. If u were finite dimensional, the posterior distribution, by Bayes' rule, 
would be given by 

P(w|y) oc ¥{y\u)¥{u). 

For infinite dimensional spaces however there is no density with respect to the Lebesgue 
measure. In this context Bayes rule should be interpreted as providing the Radon- 
Nikodym derivative between the posterior measure pfl{Au) = P(du|y) and the prior 
measure /zo(du) = P(du): 



d^i^'^ ^ ( 1 1 - - 2 



(u) cxexp(--|r-^(y-a(ii))| ). (1.4) 



The problem of making sense of Bayes rule for probability measures on function spaces 
with a Gaussian prior is addressed in [SJinillS]- In Section[2]we recall these results, and 
then, in Subsection l2.31 state and prove a new result concerning stability properties of 
the posterior measure with respect to finite dimensional approximation of the prior. 

In Section |3] we show that the observation operator Q of the elliptic problem 
described above satisfies boundedness and Lipschitz continuity conditions for appro- 
priate choices of the Banach space X. In Section |4] we combine the results of the 
preceding two sections to show that formula (|1.4p holds for the posterior measure, 
and to study its approximation with respect to finite dimensional specification of the 
prior and posterior. Section [5] contains some concluding remarks. 

2. Bayesian approach to inverse problems for functions. In this section 
we recall various theoretical results related to the development of Bayesian statistics 
on function space. We also state and prove a new result on the weak approximation 
of the posterior using finite dimensional truncation of the Karhunen-Loeve expansion. 
We assume that we are given two Banach spaces X and Y, a function $ : X x F — >• M 
and a probibility measure /Zq supported on X. Consider the putative Radon-Nikodym 
derivative 

duo Z{y) ^ 

Ziy)^ f eM~Hn;y))Mdu). (2.1b) 

Our aim is to find conditions on $ and jiQ under which jj.^ is a well-defined probability 
measure on X, which is continuous in the data y, and to describe an approximation 
result for /^^ with respect to approximation of Remarkably these results may all 
be proved simply by establishing properties of the operator $ and its approximation 
on X, and then choosing the prior Gaussian measure so that /io(X) = 1. This clearly 
separates the analytic and probabilistic aspects of the Bayesian formulation of inverse 
problems for functions. The results of this section are independent of the specific 
inverse problem described in Section [T] and have wide applicability. Note, however, 
that (|1.4p is a particular case of the general set-up of (|2.ip . with Y — M.^ . But the level 
of generality we adopt allows us to work with infinite dimensional data (functions) 
and/or non-Gaussian observational error 77. In particular if the data y — G{u) + rj 
where Q : X ^ Y is the observation operator, y is a Hilbert space and 77 is a mean 
zero random field on Y with Cameron-Martin space (i?, (•, ■)e, \\ ■ \\e) then we define 
$ as 

Hu;y)^^\\y~giu)\\l^^\\y\\l 

= l\mu)fE-{y,giu))E. 

On the other hand ii Y = M.^ and 77 has Lebesgue density p, then we define $ by 
the identity exp(— $(-u; y)) — p{y — G{u)). Note that these two definitions agree, up 
to an additive constant depending only on y, when rj is Gaussian and Y is finite 
dimensional; such a constant simply amounts to adjusting the normalization Z{y). 
The subtraction of the term in the infinite dimensional data setting is required 

to make sure that $(•; y) is almost surely finite with respect to 77 [25j . For simplicity 
we work in the case where X comprises periodic functions on the d— dimensional torus 
T''; generalizations are possible. 
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2.1. Well-defined and well-posed Bayesian inverse problems. In [51[51[^. 

it is shown that some appropriate properties of the log likelihood $ together with an 
appropriate choice of a Guassian prior measure implies the existence of a well-posed 
Bayesian inverse problem. Here, we recall these results. To this end we assume the 
following conditions on $: 

Assumption 2.1. Let X and Y be Banach spaces. The function ^ : X x Y ^ 
satisfies: 

(i) for every e > and r > there is M = Af(e, r) e R, such that for all u G X , 
and for all y E Y such that \\y\\Y < 

Hu,y)>M-e\\u\\j,:, 

(a) for every r > there exists K — K{r) > such that for all u €z X , y EY 
with max{||u||jf, ||j/||y} < r 

^{u,y) < K; 

(Hi) for every r > there exists L — L{r) > such that for all ui,U2 G X and 
u eY with max{||ui||x, \\u2\\x, WuWy} < r 

|$(ui,y) - $(u2,y)| < L\\ui - U2\\x; 

(iv) for every e > and r > 0, there is C ~ C(e, r) G M such that for all yi,y2 
with max{||?/i||y, ||?/2||y} < r and for every u £ X 

- $(it, 2/2)1 < exp(e||u||^ + C)||yi - y2||y. 

We now recall two results from [8] concerning well-definedness and well-posedness 
of the posterior measure. 

Theorem 2.2. ^Sj Let <I> satisfy Assumptions \2.lY i)-(iii). Assume that is a 
Gaussian measure with ^o{X = 1). Then given by \2.1\] is a well-defined probability 
measure. 

One can also show continuity of the posterior in the Hellinger metric c?hoii (see 
[9] for the definition) with respect to the data y. For any two measures /i and /i' 
both absolutely continuous with respect to the same reference measure, and function 
G : X ^ S with S a Banach space, 

||E'^G(w)-E^'G(u)||5 <C(E^|iG(7i)|||+E^'||GH|||)^dHcn(M,A^')- (2-2) 

Theorem 12.31 which follows is hence quite useful: for example it implies Lipschitz 
continuity of the posterior mean with respect to data. (See [8], Section 2). 

Theorem 2.3. Let $ satisfy Assumvtions [2AY i)-fiv). Assume that jiQ is a 
Gaussian measure with i.io{X) = 1. Then 

dHeu(M^M"') <C||y-y'||y 

where C = G(r) with max{||y||y, ||y'||y} < r. 

2.2. Approximation of the posterior. In this section we recall a result con- 
cerning approximation of fi^ on the Banach space X when the function $ is approx- 
imated. This will be used in the next subsection for approximation of /i^ on a finite 
dimensional space. Consider $^ to be an approximation of $. Here we state a result 
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which quantifies the effect of this approximation in the posterior measure in terms of 
the aproximation error in $. 
Define /i?'-^ by 



^H = ^exp(-$-(.)), (2.3a) 



Z^(y)= / exp(-<i>^(u))dAio(«). (2.3b) 
Jx 

We suppress the dependence of $ and <i>^ on y in this section as it is considered fixed. 

Theorem 2.4. Assume that the measures /i and /i^ are both absolutely con- 
tinuous with respect to a Gaussian /io with fio{X) = 1, and given by 112. 1\) and h2. 3^) 
respectively. Suppose that $ and $^ satisfy Assumvtions [2JV i) and (ii), uniformly 
in N , and that for any e > there exists C = C(e) £ M such that 

|$(ii) - $^(w)| < exp(e||w||| + C)ij{N) 

where ')p{N) as N ^ oo. Then there exists a constant independent of N such 
that 

d^.n{f^,fi'')<Ci;{N). 



2.3. Approximating the posterior measure in a finite dimensional space. 

In this section, we again consider approximation of the posterior measure for the in- 
verse problem on X C ^^(T''). But here we additionally assume that the approxi- 
mation is made in a finite dimensional subspace and hence corresponds to something 
that can be implemented computationally. Our approximation space will be defined 
by truncating the Karhunen-Loeve basis comprising the eigenfunctions of the 

covariance operator of the Gaussian measure fiQ. For simplicity we assume from now 
on that /io is centred (zero mean). 

Define the subpace spanned by the {ipi}fLi and let denote the comple- 
ment of in L'^{T'^). For any u S X let 

N 

u'^ ^^uicpi, with ui ^ {u,(pi), (2.4) 
1=1 

where (•,•) is the L^-inner product. The approximate posterior measure will induce 
a measure on the coefficients {ui}fLi appearing in ()2.4|) . and hence a measure 
on e . Our interest is in quantifying the error incurred when approximating 
expectations under /i*' by expectations under i/^ . 

For simplicity we consider the case where the data y is finite dimensional and the 
posterior measure is defined via (|2.ip with 



^u):^^\T-^y-giu))\\ (2.5) 

Here | • | denotes the Euclidean norm and F is assumed positive and symmetric. We 
drop explicit y dependence in $ (and approximation throughout this section. 
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Note that fiQ factors as the product of two independent measures fiQ fi^ on 
® W-^. Let be the orthogonal projection of L'^{T'^) onto , and = 
I — P^ . Any u X can be written as m = + u'^ where — P^u is given by (j2.4p 
and P^u. We define = G{P^-) and consider the approximate measure 

((23)) with $^ given by 

$» = i|r-V2(y_c^^(^))|^ (2.6) 

Because {u) depends only on m^, and because /io = ®Mcf the resulting measure 
^y,N ^ ^^-^ factored as /i*''^ = eg) /i-'- where 



N 



[u) oc exp(-i|r-V2(j^ _ a^(«))n (2.7) 

and fx-^ — Hq. The measure given by (|2.7I) is finite dimensional and amenable 
to statistical sampling techniques, such as MCMC. For the purposes of this paper we 
assume that expectations with respect to on W'^ can be computed exactly. An 
overview of techniques for sampling such measures, in a manner robust to increasing 
N, can be found in [TI3] . 

We are interested in approximating expectations under /i^ of functions G : X S, 
S a Banach space. For example, G(u) may denote the pressure field, or covariance 
of the pressure field for the elliptic inverse in Section [TJ Abusing notation, we will 
sometimes write G{u) = G{u^ ,u^). In practice we are able to compute expectations 
of G{u'^ , 0) under . Thus we are interested in estimating the weak error 

e= |1E^''G(u^,u^)-E''"g(u^,0)||s. (2.8) 

We now state and prove a theorem concerning this error, under the following assump- 
tions on Q and G. 

Assumption 2.5. Assume that X, X' and X" are Banach spaces, and X is 
continuously embedded into X' and X' is continuously embedded into X" . Suppose 
also that the centred Gaussian probability measure /io satisfies Ho{X) = 1. Then, for 
all e > 0, there is K = K{e) £ (0, oo), such that, for all ui, M2 G X , 

\Giui) - G{u2)\ < i4:exp(emax{||ui||^, ||m2||x'}) - M2||x", 
||G(ui) - G{u2)\\s < ifexp(emax{||ui||2„ ||u2||x'}) ll"i - W2||x". 

Furthermore ||-P^||£(x,X") = ^'(-^) as N ^ oo, and \\P'^\\c{x.X') bounded 
independently of N . 

Theorem 2.6. Let Assumvtions \2.5\ hold and assume that $ and <i>^ are given by 
(|2.5p and (|2.6I) respectively. Then the probability measures fj?^ and ^^'^ are absolutely 
continuous with respect to /io and given by (|2.ip and (j2.3ap . Furthermore the weak 
error (|2.8p satisfies e < G%l^{N) as N oo. 

Proof. Since X ^ X' ^ X" we have, for some constants Ci,C2 > 0, || • \\x" < 
Ci II • < ^2 II • From the assumptions on Q and P^ we deduce that Assumptions 
0;i)-(ni) hold for $ and $^ given by and (EH) respectively. Thus fi^ and /i?''^ 
are well-defined probability measures, both absolutely continuous with respect to /io, 
and satisfying n^{X) ~ fi^'^ {X) = 1. By the triangle inequality we have e < ei + 62 
where 

ei = ||E^''G(u^, u^) - W""g{u^, u^)\\s, (2.9) 
62 = ||E''"'"g(u^,u^) -E'^"g(u^,0)||s. 
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We first estimate ei. Note that, by use of the assumptions on Q and Q , we have 
that for any e > there is K — K{e) e (0, oo) such that 

Mu) - ^^{u)\ < i|r-5 (2y - g{u) - g^iu)) | |r-^ - g^iu)) \ 

<ifexp(e||u||2,)^(iV). 

By Theorem 12.41 we deduce that the Helhnger distance between fj.^ and /i^'^ tends 
to zero hke ip{N) and hence, by (|2.2p . that ei < C4>{N). This last bound fohows 
after noting that the required integrabihty of ||G(m)||| and 110(7/^)111 follows from 
the Lipschitz bound on G, the operator norm bound on and the Fernique theorem 

We now estimate 62- Because E'' G(w^,0) = W G{u^ ,0) we obtain 

e2<W^"'"\\G{u)~G{u^)\\s (2.10) 
From the Lipscthiz properties of G we deduce that 

62 < i^i(e)E^''-"(exp(emax{||u||2„ ||F^m|||,})||P^u||x„) 

< K2{e)E^^'-" {exp{Ce\\u\\j,)\\u\\x)m) 

< if3(e)E^'"" {exp{2Ce\\u\\j,))i:{N) 

where G is independent of e. The result follows by the Fernique theorem. □ 

The results of this section are quite general, concerning a wide class of Bayesian 
inverse problems for functions, using Gaussian priors. These results can also be gen- 
eralized to the case of Besov priors introduced in |16j and will be presented elsewhere. 

In the next section we establish conditions which enable application of Theorems 
12.21 12. 3[ 12. 41 and |2. 61 to the specific elliptic inverse problem described in Section [TJ We 
then apply these results in section |4l 

3. Estimates on the observation operator. In order to apply Theorems l2.2l 
l2.3[|2.4l and l2.6l to the elliptic inverse problem described in section [T] we need to prove 
certain properties of the observation operator g given by (jl.3p . viewed as a mapping 
from a Banach space X into R™, and the function G : X ^ S. Then the prior measure 
^0 must be chosen so that iJ.o{X) = 1. It is hence desirable to find spaces X which are 
as large as possible, so as not to unduly restrict the prior, but for which the desired 
properties of the observation operator hold. As discussed in section [1] we consider 
the observation operator obtained from either the pointwise measurements of p or 
bounded linear functionals of p € H^{D). We obtain the bounds on the observation 
operator for each of these cases in the following. 

3.1. Measurements from bounded linear functionals of p G H^{D) . In 
this case, using standard energy estimates, we have the following result: 

Proposition 3.1. Consider equation U.l\) with D C M'', d = 2,3 a bounded 
domain, the boundary of D, dD, G^-regular, f G H^^{D), g G L^{D) and assume 
that (f> may he extended to a function (p G H^{D). Then there exists a constant 
G = G(||/||//-i, ||5||i2, ||0||//i(D)) such that: 
i) ifu& L°"{D) then 

Ibllffi(D) < G exp(2||u||ioo(£,)); 
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a) ifui,U2 G L°°{D), andpi,p2 are the corresponding solutions of then 
\\pi -P2\\m{D) < G exp(4max{||ui||Loo, ||ii2||L-})||Mi - M2||l~- 



Corollary 3.2. Let the assumptions of Proposition \3A\ hold. Consider Q(u) = 
(li{p), . . . , 'k(p)) with Ij, j = I, . . . ,K bounded linear functional on H^{D). Then 

for any u,ui,U2 G L°°{D) we have 

<Cexp(2l|u|Uoo(^)), 

and 

\Q{ui) - g{u2)\ < C exp(4niax{||wi||L<», ||u2||loo}) - W2||loo(£,), 

with C = C{K, ||g||L2, maxj H^-i). 

Proof, [of Proposition 13. 1| i) Substituting q = p — in (jl.ip and taking the inner 
product with q, we obtain 

e-M--\\\/q\\L2 < ell"ll-- + + H^IU^ 

and therefore 

II VpIU. < (1 + c2|l"ll-~ ) II V<^|U. + ell"ll-~ (11/11^-. + IlfflU.) (3.1) 

which imphes the resuh of part (i). 
ii) The difference pi — p2 satisfies 

V • (e"W(pi - P2)) = V • ((e"^ - e"0Vp2). 

Taking the inner product of the equation with pi — p2 gives 

e-ll-ilU»||v(pi-p2)||2, < ||e"^-e"MU-||Vp2||L2||V(pi-p2)||L- 

For any x G I? we can write 



1 

{u2{x) - ui{x)) I e^"^+(i-")"i ds 



< 11^2 - wiIIl- e'"'''^<ll"ill^°°'ll"=ll^°°>. 

Hence using the estimate for ||Vp2||l2 from part (i), the resuU follows. □ 

3.2. Pointwise measurements of p. Here we obtain bounds on the L°°-norm 
of the pressure p. 

Proposition 3.3. Consider equation U.l]) with D C M'^, d = 2,3 a bounded 
domain, the boundary of D, dD, C^-regular, f G L^(D), g G L'^^{D) with r > d/2 
and G L°°{dD). There exists C — C{K,d,r, D^supgjj |0|, ||/||l'-, l|g||L2r) such that 

\\p\\l°°{D) < C exp(||w||L=e(£,)). 



Proposition 3.4. Let the assumptions of Proposition [373\ hold. Suppose also 
that (j) may be extended to a function (j) G W^'^^ {D). Then: 

i) the mapping u i-^ p from C{D) into L°°{D) is locally Lipschitz continuous; 
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a) assume that Ui G L°°{D), U2 G C'^{D) for some t > Q, and pi,P2 are the 
corresponding solutions of I _?._?)) . Then for any e > there exists C depending 
on K,d,t,e, llfflli^^ and ||0||;yi,2r such that 

\\Pi -P2||l-(d) < C exp (coniax{||Mi||i«>(£,), ||u2||c*(d)}) II"i - W2||l~(d) 

where cq = 4 + (4 + 2d)/i + e. 
Corollary 3.5. Let the assumptions of Proposition [STB hold. Consider Q{u) = 
{li{p), . . . , Ik{p)) with Ij, j = 1, . . . , if pointwise evaluations of p at Xj G D. Then 
for any u G L°°{D) there exists C — C{K,d,r, DjSwpgj^ ||.9||L2r) such that 

\g{u)\ < C exp(||w||i^(£,)). 

If Ui G L°°{D), U2 G C^{D) for some t > and (p can he extended to a function 
(p G W^'^''{D) then, for any e > 0, 

\Q{ui) - ^(^2)1 < C exp (comax{||ui||ioo(£,), ||w2||c'(Z3)}) ll^^i - ■«2||l~(d) 

with C = C{K,d,t,e, II/Hl--, llfflU^--, II^Hivl^--) and cq = 4 + (4 + 2d)/t + e for any 
e > 0. 

Proof, [of Proposition 13. 3j By Theorem 8.15 and 8.17 of [13] we have, recalhng 
the definition of A, 

sup \p\ < sup !</)! + C{d, r, \D\) (\\poh^ + lll/lli. + hg\\L2. 



D dD 



A"-"'" A' 



where po is the solution of ()l.ip with cf) = 0. Taking the inner product of (jl.ip with 
po we obtain, for a = Ci{d,r, \D\), 

||Vpo|U^<y(||/||H- + ||g||LO 



Hence 



<y(ll/lk.- + ||.9||L0- 



sup \p\ < |CK r, D) (sup 101 + ll/lli. + \\g\\L2r) (3.2) 

D A dD 



and the result follows since A > e . □ 

Proof, [of Proposition 13. 4| The difference pi — p2 satisfies 



where 



V • (e"iV(j5i -P2)) = V • F, xeD, 
pi{x) = P2{x), X G dD, 



(3.3) 



F = -(e''i(^) -e"^(^))Vp2. 
Let 

Am = min{A(?ii), A(m2)} and A„i — max{A(ui), A(w2)}. 



By p.2p we have 



suplpi-p2|<^^^^^||F||i.., (3.4) 

D Am 
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for r > d/2. Now, ||F||i2r may be estimated as follows, using Theorem IA-3| 

Ili^lU- < ll(e"^ -e"^)Vp2||L- 

< A„ ||ui - U2||l°° ||Vp2||L2r 

< A,nC{d,r,D,U2){\\f\\L'' + hh^r- + 11011^1,20 hi - W2||l-(D) 

where in the last line we have used the fact that 2rd/{2r + d) < r. This gives the 
Lipschitz continuity. 

To show the second part, we use p.4p and Corollarv lA-41 to write 

\\pi-P2\\l^(d) < ■^Cid,r,D)\\F\\L2. 



Xn 

< ^C{d,r,D)\\Vp2\\L-r \\u, - u^h^^D) 

Am 

< C{d, D, r, t)Ml±^ (l + (A™/Am)^ h2||^^)) 



X [1 + (Am/A 
X (ll/IU- + \\9\\l^'- + UWw^.^'-) - U2||l-(D)- 

Since 1/Am, Am < exp{l|ui||ct, ||w2||c'} and for any e > there exists c = c{e,t) such 
that 

^'^^\t^'''\ l + (Am/Am)"^ h2|lS?i.)) (l + (Am/Am)^ h2|li(^)) 

< C(e)exp(co(t)max{||Mi||L~, ||u2||c*}) 

with Co = 4 + (4 + 2d)/t + e. The resuh follows. □ 

We can now summarize our assumptions on the forcing function and boundary 
conditions of (jl.ip for our two choices of the observation operator Q as follows. We 
will use these assumptions in subsequent sections. In both cases covered by these 
assumptions it is a consequence that $ and Q satisfy Assumptions 12.1 1 and 12.51 

Assumption 3.6. We consider the observation operator G{u) = (hip), ■ ■ ■ , 'k(p)) 
defined as in U.S\) with D C M*^ a bounded open set with regular boundary. Then 
either: 

i) the mapping Ij is a bounded linear functional on H^{D) for j = 1,...,K 
and we assume that f £ H^^{D), g £ L^{D) and 4> may be extended to 
(t>&H^{D); or 

ii) the mapping Ij is the pointwise evaluation of p at a point xj £ D for j = 
1, . . . , AT and we assume that f € L^(D), g G L^'^(D) and (p may be extended 
to (/)£ W'^^'^^'iD), with r > d/2. 

4. Properties of the posterior measure for the elliptic inverse problem. 

We use the properties of the observation operator Q for the elliptic problem to establish 
well-posedness of the inverse problem, and to study approximation of the posterior 
measure in finite dimensional spaces defined via Fourier truncation. 

4.1. Well-posedness of the posterior measure. Here we show the well- 
definedness of the posterior measure and its continuity with respect to the data for 
the elliptic problem. We have the following theorem: 

Theorem 4.1. Consider the inverse problem for finding u from noisy observa- 
tions of p in the form of M.'A) and with p solving in D = T'^ . Let Assumption 
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\3.6\ hold and consider /Iq to be distributed as Af{0, (—A) with A the Laplacian op- 
erator acting on H'^{T'^) Sobolev functions with zero average on T"^, and s > d/2. 
Then the measure fj,{du\y) = ¥{du\y) is absolutely continuous with respect to fiQ with 
Radon- Nikodym derivative given by \2.1\ . (j2.5p . Furthermore, the posterior measure 
is continuous in the Hellinger metric with respect to the data: 

dHe„(M^A*^') <C|2/-y'|. 



Proof. Let X = C*{D). We first define measures ttq and tt on X x as follows. 
Define 7ro(du,d?/) = /io(dM) (3 p{dy) where p is a centred Gaussian with covariance 
matrix T, assumed positive. Since Q : X —> M.^ is continuous and since Lemma 6.25 of 
pS] shows that HoiX) = 1 for any i G (0, s — d/2), we deduce that Q is /ig measurable 
for t e (0, s — d/2). We define p{dy\u) = Af{Q{u), T) and then by /iQ-measurability of 
Q, 7r(dw, dy) = p{dy\u)iiQ{du). From the properties of Gaussian on we have 

^{u;y) cx exp(-$(u;?/)) 

with = i|r~-^/^(y — We now show that Assumptions 12. II (i)-fiv) hold 

for this $. Assumption 12. If i) is automatic becuase 



> 0. 



By Corollaries 13.21 and l3.5[ Q is bounded on bounded sets in X, and Lipschitz on X, 
for any t > 0, proving Assumptions 12.11 (ii). (iii). To prove Assumption 12.11 (iv) note 
that 

-$(M;y2)| < ^l^'Hyi + y2 - Giu))\\r-^yi - y2)\ 
< ci exp(c2||M||x)|yi - 2/2 



and 

exp(c|lM|lx) < ci(e)exp(e||u||^). 



By Assumption 12.11 (ii) we deduce that 

/ exp(-$(u; y)) poidy) > exp{-K{r)) Mo(||w||x < r) > 0. 
Jx 

By conditioning (see Lemma 5.3 in [TS] or Section 10.2 in ^12^) we deduce that the 
regular conditional probability ii^i^du) = P'^(dM|y) is absolutely continuous with re- 
spect to fiQ and is given by (jl.4p . Continuity in the Hellinger metric follows from 
Theorem [^1 □ 

In the case of a general bounded domain D the prior measure po J\f{0,A^'^) 
where s > d — 1/2 and A is the Laplacian operator acting on D{A) = {u G H^{D) : 
Vu ■ n\gD — and JjjU = 0}, satisfies /xo(C*(D)) ~ 1. Hence the techniques of the 
preceding theorem can be used to show wellposedness of the posterior in this case 
provided s > c? — i . 
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4.2. Weak approximation in a Fourier basis. Let x — {xi, . . . , Xd) G T'K 

With ipk,,...M = e*(*^-i-i+-+'=''^''), the set {ipk^,...M}kl,...Mez forms a basis for L2(T^). 
Define 

= span{(^fe,,...^fc,, < iV, . . . , < N} 

and recall the notation established in subsection [230 We let p denote the i?^— valued 
random variable found from solution of the elliptic problem (jl.ip with u distributed 
according to the posterior fj.^ and the analogous random variable with u = Up 
distributed according to ly'^ with the Fourier truncation described above. We have 
the following approximation theorem: 

Theorem 4.2. Consider the inverse problem of finding u from noisy observations 
of p in the form of ll.2\} and with p solving il.l]) . Let Assumption \3.6\ hold and 
consider /io to be distributed as Af{0, (— A)~*) with A the Laplacian operator acting 
on H'^{T'^) Sobolev functions with zero average on T"^, and s > d/2. Then, for any 
t<s-^, 

\\W'"p-E''"p^\\hi <cn-\ 
and, with p = W^p, p^ = E^^p^ and S = C{H^{T'^), H'^{T'')) we have 

||E^"(p -p) ®{p-p)~ E''"(p^ -p^) ® (P^ -P^)\\s < CN'K 



Note that the mean and covariance of the pressure field, when conditioned by 
the data, may be viewed as giving a quantification of uncertainty in the pressure 
when conditioned on data. The previous theorem thus estimates errors arising in this 
quantification of uncertainty when Karhunen-Loeve truncation is used to represent 
the posterior measure. 

Proof, [of Theorcm|12] We apply Theorem [H] with G{u) = p and S* = H^{D) or 
G[u) = p®p and S = C{H^(T'^), H\T^)). We choose X' = X" = L°° and X = C* for 
any i < s — | . Then X is continuously embedded into X' and X' into X" and, under 
the assumptions of the theorem, iiq{X") = ^^{X') = Ho{X) = 1. From Proposition 
13.11 it is strightforward to show the required Lipschitz condition on G (in either the 
pressure or pressure covariance cases) whilst the required Lipschitz condition on Q 
follows from Assumptions 13.61 It remains to prove the operator norm bounds on . 
We consider dimension d ~ 2 first. We write 

-N<k<N -N<j<N 



= ^ r r«(c,e)e-^(^^+«'-)dcdee^(-^+'=^) 

-N<k<N -N<j<N J-7V J-TT 

uiCODNix-ODNiy-OdCd^ 

u{x-C,y-ODNiC) Dn{0 dCdi 



7r2 



-TT •/ —TT 
TT /'TT 



^The slightly different interpretation of A'' should not cause any confusion in what follows. 
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where [25] 



n ^^ 1 txn 1 sin(iV + l/2)a; ,^ , 

-N<n<N ^ ' ' 



Noting that D]y[x) dx — vr, we have 

Up{x,y) -u{x,y) ^ j j (u{x - C,y - - u{x,y)^ DNiC) D^iO dC 

+ u{x - C, y) - y)) i?Ar(C) DNiO dCdf 

- C, y - - ^(a^ - C, y)) Dn{0 ^A'(C) dC 
+ (u{x~C,y)-u{x,y))Dr,{OdC J 0^(0 d^ 



To estimate the right-hand side we set /(^) — u{x — CtV ~ ~ "(^^ ~ Ci v) for fixed 
a;, Cj y S T, and noting that /(^) is periodic we write 



TT / />7r 



2 r /(o^^(Odc= r ; 

^ — TT J —TT ^ 



^ -^7jL^^^iiN + 1/2)0 

"+"1/2 /(C + AT +1/2) 



^ ^ sin ((iV+ 1/2)0 dC 



fain^2 + 2lv+T^ 

1 r /(^) ^(^+ivfT72)' 



2 7_. \^sin(e/2) sin(| + 5^) 



sin ((Ar+ 1/2)0 dC 



In the third hne we have used J_^_^g{£,) dS, = J^_^g{S,) d^, for any 2tt periodic 
function g and any a G R. Let h = 2^^. We can write 



fiODNiOd(< 



sin(e/2) sin(«±^) 
h+h+ h 



dC 



with Ii — , I2 ~ J_l^ and I3, = of the integrand in the right-hand side of the 
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above inequality. Noting that /(O) — 0, we have 



sml 



+ /(0 



< chU 



1 



<c/i*||/||c*logf + c/i 



^ + h 
1 

h 



sin(e/2) sin(f±^ 

" i|/||c'4'(siii(4/2 + /'/2)-sm(</2)) 



d5 



+ 



sin(^/2) sin(^/2 + h/2) 



< c 



<c/i*||/||c* log- + c/i*||/||c*. 



Similarly 



-r 

J — TT 



sin(l) 



1 



1 



d^ 



sin(f±^) sin(C/2) 
" ^"c* 1^ + /in sin(e/2) - sin((^ + h)/2)\ 



|sin(^/2)||sin((C + /i)/2)| 



dC 



<c/i*||/||c* log- + ch 



-2h 



d^ 



<c/i*||/||c* 



log ^ + mc. ^ d^ + ii/iic. ^^^^ 



<cft*||/||c* log- + c/i*||/||c*. 



h 



Finally 



f 

J-h 



dC 



<cl|/l|c* 
< c/i* 



lie- 



Hence we have 



r (w(ar-C,y-0-«(a;-C,2/))£>iv(OdC<C7V-*||u||c« logA^, 

J —7T 

(u{x ~C,y)- uix,y)) DNiO dC < CN-'\\u\\cn log TV. 

r'"..^. .^ , r 1 , r |sin(iV + l/2)cc| 
dx < / (27V + 1) da; + / ^ d.T + / ' ^ ' ^ ' 



and 



Now since for fixed e > sufficiently small, 

" |sin(Ar + l/2)x| r^^^ 



|sin(x/2)| 



|sin(a;/2)| 



da; 



<(2 + l)e + 21ogTV + C(e) 

< c log N as N oo, 
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we have ||£'7v(C)llLi(-7r,7r) ~ O(logiV) and therefore 

\v^p(x,y)-u{x,y)\<C\\u\\c^i^D)N~'^o%Nf, for any x.y^T'. 

Similarly in the three-dimensional case one can show that 

ll"F - "IU~(D) < G hllc'(D) (logiVf. 

Since t can be chosen arbitrarily close to s — | we obtain ||-P^ = 0{N~^) 
for any i < s — |. This, since X' — X" , implies that ||-P^||£(x,x') is bomided 
independently of X . The result follows by Theorem 12.61 □ 

5. Conclusion. We have addressed the inverse problem of finding the diffusion 
coefficient in a uniformly elliptic PDE in divergence form, when noisy observations 
of its solution are given, using a Bayesian approach. We have applied the results of 
[8] on well-definedness and well-posedness of the posterior measure to show that for 
an appropriate choice of prior measure this inverse problem is well-posed. We also 
provided a general theorem concerning weak approximation of the posterior using 
finite dimensional truncation of the Karhunen-Loeve expansion: Theorem 12.61 We 
have then used the result of this theorem to give an estimate of the weak error in the 
posterior measure when using Fourier truncation: Theorem 14.21 Future work arising 
from the results in this paper includes the possibility of application to other inverse 
problems, the study of rare events and the effect of approximation, and the question 
of obtaining improved rates of weak convergence under stronger conditions on the 
mapping G. Also of interest is the extension to non-Gaussian priors of Besov type 

m- 

Appendix A. Let D C M'' be open and bounded and -p G Wq''^(I)) satisfy the 
following integral identity 

/ Vw • (aVp + e) + /u dx = 0, (A-1) 
J D 

for any v G Cq (D). We find an estimate for the W^''^ norm of p with special attention 
on how the upper bound depends on the diffusion coefficient a. The results of this 
Appendix are obtained using slight modification of the proof of Shaposhnikov [24] for 
our purpose here. 

In the following. Lemma [A- II gives an estimate for the W^ '^ norm of p over i3, 
a ball of sufficiently small radius in and of centre G M'*. Lemma IA-21 gives a 
similar result for the case that the domain is B n {(x^, . . . , x'^) G M'' : a;'' > 0}. This 
lemma allows us to consider the effect of the boundary when generalizing to a bounded 
domain D. Lemma [A-ll and lA-21 are then used to prove Theorem IA-31 which gives an 
estimate for in a general bounded domain D. Finally in CoroUarv I A-41 we 

consider a G C*{D) and obtain an estimate for with a polynomial dependence 

on ||a||c'(D)- 

Notation: In this appendix we use the operators Pr and Qr which for u a vector 
valued function and g a scalar function are defined as 

Pr{9){y)^l K{x-y)g{x)dx Q^{u){y) ^ j \7K{x - y) ■ u{x) dx, 
where 

K{y) = \ t^^TwW-' ^>2, 
I 2^^n\y\, d = 2. 
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Also for any r > we define 

5(0, r) = {x e M'* : \x\ < r}. 

Lemma A-f. Let a G C(-B(0,f)) and a(0) = Oq. There exists r < 1 such 
that if p e W^'\B{0,r)) satisfies [11]} with D = B{0,r), P^f G T^i'«(B(0, r)), 
e e i^(i?(0, r)), and supp p, supp /, supp e G B{0,r), then, letting B — B{0,r), 

lblki.,(B) < ^^^(1 + r) iWehHB) + WPrimw^^HB)), (A-2) 

with 

{l + r)Coid,q) 

Ci = 1 sup \a - ao\ > 0. 

A B 

Lemma A-2. Let G{0,r) = B{0,r) n {{x^ , ■ ■ ■ ,x'^) : x'^ > 0} for r > 0. Suppose 
that in the assumptions of Lemma HA-ll) . B{0, 1) and B{0, r) are replaced with G{0, 1) 
and G(0,r). Assume that the functions p, f and e vanish in a neighborhood of the 
spherical part of the hemisphere G{0,r) but not necessarily on G{0,r) f) {x"^ ~ 0}. 
Then the result of Lemma lA- 1\ holds. 

The above results follow from the proofs of Lemma 2 and 3 of [23] . 

Theorem A-3. Assume that D C M."^, d = 2,3, is a bounded G^ domain, and 
a G G(D) with 

0<A<a<A<oo. 
Suppose also that e G L'^[D) and f G L^{D). Then for 2 < q < 6 
C{D,d,q) 



A 

where 6 is a positive constant that satisfies the following: 

max \a{y) - a{x)\ < , for any x e D. 

where Go{d,q) is the constant in Lemma \A-l[ 

Proof. Choose r^ so that for any x € D there exists a ball of radius rjj inside 
D that contains x. Let r = mm{r]j,6}. Corresponding to r, consider {xj}j^^ C D 
so that the set of the neighborhoods of these points, {U{xj)}j^i defined as follows, 
forms a cover of D: 

- for Xj G D, U{xj) — B{xj,r), 

- for Xj G dD, U{xj) = B{xj,r) HD and there exists G^ mapping ipj such that 
TPj{U{xj)) = Glxj,r) where G{xj,r) = B{xj ,r) n {{x\ ■ ■ ■ ,x'^) : x"^ > x'^}, 

- and there exists a partition of unity {Cj}/=i subordinate to {U{xj)}. 
Let Wj = £,jp. Hence p = ^j- Define 

e = £,je — apVS^j and f — ijf + aV^j • Vp. 
On U{xj) with Xj G D, Wj satisfies 



/ Vw • {aVwj +e) +vfdx ^ 0. 

JB(xi.r) 
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By Lemma I A- 11 with Bj = B(xj,r), we have 

\\Wj\\w^.,(Bi) < '^''^''^V + ^)(l|e||L^(B,) + \\Prif)\\w^.^{Bi))- 

To estimate |le||/^5(Bj) we write 

||e||Li(i3^) < |IOe|U5(i3,) + WaV^jpWLoiB,) 

< (l + A)C(e„VO)(||e|U, + |b|U,) 

r 

For \\Pr{f)\\w^-''{Bj), by Sobolev embedding theorem (assuming that 2 < q < 6) and 
since by Theorem 9.9 of ^14 UPrffUffs < C((i)||(7||i2, we have 

\\Prif)\\w^^.iD) < CiD)\\Prif)\\H2 

< C{D,d)\\fh2 

< C{D,d)m,fh2 + \\aV^,-\/p\\L^) 

< Ve,)(l + A)(||/|U. + iivpiuo 

< ^ ^(II/IIl^ + I|Vp|U2). 

Since 2 < q < 6 and D is bounded, 

Ml. <c||Vp|U. <c(||/|U. + ||e|U.) 

where the second inequahty is obtained by taking the inner product of (jA-ip with p 
(noting that p € Wq'''{D) and hence p\dD = in the trace sense). Therefore 

lk,lki..(B,)<^^^^(l + A)(l + r)(||e|U, + ||/|U.)- (A-3) 

It remains to consider the case that Xj G dD. For such Xj, Wj on U{xj) satisfies 
(using the map V'j defined at the beginning of the proof) 



/ Vu • {aVwj + e) +vfdx = 0. 

JGix^.r) 



IG{xj,r) 

where a, e and / depend on VtAj . It is not difficuh to see that |V'(/'j| < C where C 
only depends on the properties of the boundary of Z?, therefore in a similar way to 
the above argument and using Lemma IA-21 it can be shown that 

Ik. < ^^^^(1 + A)(l + r)(||e|U, + ll/IUO- 
Now we can write 

< ^%f^\ ^ + m + r){\\e\\L. + \\f\\L^) 



^ C{D,d,q) 

A 



^ CiD,d ,q) , 1 



(l+jiTd) (l + A)(l + '5)(||e||L,+ 
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and the result follows. □ 

In order to quantify d in the above theorem, in terms of the norm of the space 
that a lives in, we need to assume a to be Holder continuous: 

Corollary A-4. Suppose that the assumptions of Theorem \A-S\ holds. Assume 
also that a is t-Holder continuous in D. Then 

II II ^ C{D,d,q,t) f \m\ct(D) \/ ll"llc'(D)\ , .w|| II , ||„|| . 

Proof. Since \a{x) — a{y)\ < \\a\\ct\x — y\*, S of Theorem IA-31 satisfies 5 < 
cA"'^/* ||a||^l^^^j and the result follows. □ 
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